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400 ARMY NAVY DRIVE 
ARLINGTON, VIRGINIA 22202-4704 


September 20, 2006 


MEMORANDUM FOR DIRECTOR, NATIONAL SECURITY AGENCY/CHIEF 
CENTRAL SECURITY SERVICE 


SUBJECT: Audit of TRAILBLAZER Program Execution (Report No. 06-INTEL-13) 


(U) We are providing this report for information and use. The National Security 
Agency provided comments. We considered management comments on the draft of this 
rt when preparing the final report. The complete text of the comments is in the 

lanagement Comments section of the report. 


(U) Comments on the draft of this report conformed to the requirements of DoD 
Directive 7650.3 and left no unresolved issues. Therefore, no additional comments are 
required. 





т MEA 


ыт (с) Shelton К. Young 
Deputy Inspector General 
for Intelligence 
Specht Warning- 








ей Stetes Code $ 402 (note). Reprötfuctiem-ar.cemo 
ds must be taken to prevent publication or improper dis 
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Office of the Inspector General of the Department of Defense 


Report No. 06-INTEL-13 September 20, 2006 
(Project No. D2006-DINT02-0055.000) 


TRAILBLAZER Program Execution (U) 


Executive Summary (U) 


(U) Who Should Read This Report and Why? DoD, Intelligence Community, and 
congressional officials who are interested in the TRAILBLAZER Program should read 
this report. The report discusses whether the government received benefits from its multi- 
year investment in the TRAILBLAZER Program. 


Background. In November 2000, the National Security Agency recognized 


that to fulfill its intelligence mission, it needed to develop capabilities to intercept and 


exploit new digital tec! ologies being used on the Global Net. The National Security 
Agency further recognized that it needed to transform the way it conducted business. 
TRAILBLAZER was one of several programs initiated in November 2000 to fulfill these 
needs. The National Security Agency spent approximately $696 million on the 
TRAILBLAZER Program from October 1, 2001, through September 30, 2005, 


{5789 Results. TRAILBLAZER encountered significant developmental problems and 
was unable to pass the system development and demonstration (Milestone B) phase of the 
DoD Acquisition process. In November 2005, when the National Security Agency 
management recognized that TRAILBLAZER was not going to accomplish its objectives, 
it restructured the program. We identified several areas in which TRAILBLAZER 


expenditures resulted in mission improvements; specifically, target development and 
igital networks. The National Security Agency is 
incorporating other BLAZER technology into ongoing developmental projects. 
(U) Management Comments and Audit Response. We provided a draft of this report 
on August 14, 2006. Although no comments were required, the Chief of Staff for the 
National Sechrity Agency stated that National Security Agency "agreed" that the report 
fairly and accurately portrays the facts related to the TRAILBLAZER Program. National 
Security Agehcy suggested changes that would offer greater clarity to the report. We 


considered their comments and made changes that we deemed appropriate. See the 
Management'Comments section for the complete text of the comments. 


(b) (3) L. 86-36 
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Background (U) 


5455 The TRAILBLAZER Program. In November 2000, the National 
Security Agency (NSA) recognized that it needed to develop capabilities to 
intercept and exploit new digital technologies being used on the Global Net and to 
transform the way it conducted business. Consequently, NSA initiated seven 
transformation programs, one of which was the TRAILBLAZER Program. 
TRAILBLAZER was to provide common services and applications for NSA 
general collections processing and analytical operations by integrating the tools 
and applications of organizational missions to a standard infrastructure. 


=S} In 2004, Congress designated all transformation programs as major defense 
acquisitions and designated the Under Secretary of Defense for Acquisition, 
Technology and Logistics as the Acquisition Decision Authority. NSA spent 
approximately $696 million on the TRAILBLAZER Program from 
October 1, 2001, through September 30, 2005. 


(S) Developmental Concerns. NSA encountered significant developmental 
problems with TRAILBLAZER, and it was not able to complete system 
development and demonstration (Milestone B phase) of the DoD acquisition 
process. In the markups to the FY 2006 Intelligence Authorization Act, the 
Senate Select Committee on Intelligence and the House Permanent Select 
Committee on Intelligence concluded that TRAILBLAZER continued to struggle 
to define requirements, an executable schedule, and a credible program plan. On 
November 10, 2005, NSA received approval from the Milestone Decision 
Authority to restructure the program from a single, large program to an integrated 


set of multiple, smaller programs. Those smaller proga ы were designated as 
ial interest programs within TRAILBLAZER to eren], 
Doreen formation management and analyst ОЕ. information techno! 
пт and-integration and testing. However, as “of June 2006, NSA had 
not completed specific réquirements,and objectives for those special interest } 


programs. Penna, : 
№ 
Objectives (U) 


(U) The initial audit objective was to respond to a request from the Senate Select 
Committee on Intelligence to determine why the TRAILBLAZER Program was 
unsuccessful, what lessons should be learned, how to apportion responsibility for 
the program’s problems, and what the Government received from its substantial 
multi-year investment. Because there was conflicting language from another 
committee, we modified the audit scope to determine only what the Government 
received from its investment in the TRAILBLAZER Program. 
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TRAILBLAZER Program Return on 
Investment (U) 


#8689 NSA spent approximately $696 million on the 
TRAILBLAZER Program from FY 2002 through FY 2005 before 
restructuring the program. NSA t approximately ercent of 
TRAILBLAZER funds ii ojects. They w e: 


+ Technology Demonstration Platform (TDP), ; 


The following figure shows how NSA spent the funds among the ` 
TRAILBLAZER projects. TRAILBLAZER expenditures resulted in *, 
improvements primarily in target development.an 


Lal networks. NSA is incorporating pther R, 
technology inte opgoing developmental projects: +: . 





(b) (3)-P.L. 86-36 
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TRAILBLAZER Expenditures in millions from FY 2002 through FY 2005 
-6+89- 
Technology Demonstration Platform (U) 


(U/FO¥V9) Technology Demonstration Platform (TDP) Objectives. The TDP 
was to reduce technical and program risk by demonstrating, evaluating, and 
integrating solutions to exploit the global network, using industry capabilities, 
knowledge, and government core competencies. The TDP was also supposed to 
create strategic knowledge bases on targets and product lines as well as the data 
mining and discovery tools to use with those knowledge bases. In December 
2004, NSA modified the TRAILBLAZER acquisition strategy to address concerns 
that the TDP was behind schedule, over budget, and not reducing risk sufficiently 
rt the Milestone B decision. NSA rescoped and renamed the TDP as 
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875%) NSA spent approximatel, 
FY 2002 to FY 2005 in developing and enhancin; 
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Summary (U) 





48739 The following table indicates the status of systems dr technology 
developed under the TRAILBLAZER components included'in our review. 
Because NSA, DoD, and Congress determined that the TRAILBLAZER Program 
did not meet its objectives, our characterization indicates onky what was 
developed as part of the TRAILBLAZER Program 


the success or 
* Our conclusion is that! 
the efforts funded by ER that have 
contributed most to operational effectiveness. 
ER 


Major Components of TRAILBLAZER 


TRAILBLAZER Current 
Components i Status 
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Management Comments on the Finding and Audit Response 


(U) Management Comments and Audit Response. The Chief of Staff for NSA 
provided comments on the report. NSA “agreed” that the report fairly and 
accurately portrays the facts related to the TRAILBLAZER Program. NSA 
suggested changes that would offer greater clarity to the report. We considered 
their comments and made changes that we deemed appropriate. See the 
Management Comments section for the complete text of the comments. 
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Appendix A. Scope and Methodology (U) 


(U) We reviewed major components that the TRAILBLAZER Program funded 
from FY 2000 through FY 2005. We reviewed contract documentation, invoice 
transactions, test reports, and e-mail correspondence dated from September 2002 
through June 2006 to determine benefits that the Government received from the 
TRAILBLAZER investment. We also conducted interviews with program 
managers, engineers, contracting officers, and finance personnel. We 
judgmentally selected a contract that was active throughout the life of 
TRAILBLAZER and observed operations at selected sites. 


(U) We performed this audit from November 2005 through July 2006 in 
accordance with generally accepted government auditing standards. 


(U) We did not review the TRAILBLAZER management control program because 
it was not within the scope of the audit. Also, the National Defense Authorization 
Act for FY2004 cited that NSA acquisition management of major programs was 
not mature. 


(U) Use of Computer-Processed Data. We did not use computer-processed data 
to perform this audit. 


(U) Government Accountability Office High-Risk Area. The Government 
Accountability Office has identified several high-risk areas in DoD. This report 


provides coverage of the Protecting the Federal Government’s Information 
Systems and the Nation’s Critical Infrastructures high-risk areas. 


Prior Coverage (U) 


(U) During the last 5 years, the Ins} r General of the Department of Defense 
and the Inspector General of the NSA have issued two reports discussing the 
TRAILBLAZER Program. 


IG DoD (U) 


(U//FGUQ) Report No. 05-INTEL-03, “Requirements for the TRAILBLAZER 
and THINTHREAD Systems,” December 15, 2004. 


IG NSA (U) 


Pee 


(b) (3)-P.L. 86-36 
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Appendix B. Report Distribution (U) 


(U) 


Office of the Secretary of Defense 


Under Secretary of Defense for Acquisition, Technology, and Logistics 

Under Secretary of Defense (Comptroller) 

Under Secretary of Defense for Intelligence 

Assistant Secretary of Defense for Networks and Information Integration/Chief 
Information Officer 


Other Defense Organizations 


Director, National Security Agency/Central Security Service * 
Inspector General, National Security Agency 

Inspector General, Defense Intelligence Agency 

Inspector General, National Geospatial-Intelligence Agency 
Inspector General, National Reconnaissance Office 


Non-Defense Federal Organization 


Inspector General, Office of the Director of National Intelligence 
Assistant Deputy Director/Senior Acquisition Executive, Office of the Director of 
National Intelligence 


Congressional Committees and Subcommittees, Chairman and 
Ranking Minority Member 


Senate Subcommittee on Defense, Committee on Appropriations 
Senate Committee on Armed Services 

Senate Select Committee on Intelligence 

House Subcommittee on Defense, Committee on Appropriations 
House Committee on Armed Services 

House Permanent Select Committee on Intelligence 


* Recipient of draft report 
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National Security Agency Comments (U) 














UN 


NATIONAL SECURITY AGENCY 
FORT GEORGE G. MEADE, MARYLANO 20755-6000 


8 September 2006 


MEMORANDUM FOR INSPECTOR GENERAL, DEPARTMENT OF 
DEFENSE 


SUBJECT: (U) Comments on DoD IG Draft Report titled “Audit of 
TRAILBLAZER Program Execution, Project D006-DINT02- 
0055.000” - INFORMATION MEMORANDUM 


(ОЛРӘМӨЎ We appreciate your audit team's willingness to provide an 
opportunity for us to review a Discussion Draft of the subject report, and the 
extent to which you incorporated our feedback into that document. We 
believe that, in the process to reduce the Final Draft to a more manageable 
size, some meaning was inadvertently changed from the Discussion Draft. 
These changes are of sufficient importance to us to be noted, and we 
respectfully request that our attached comments be considered in preparation 
of your Final Report. 


(UIP With these limited exceptions, we believe your report fairly 
and accurately portrays the facts related to this Program. We look forward to 
receiving your Final Report. 





UNCLASSIFIED//RGRPOPPIGINEMHORONP 
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(b) (3 
(b) (5) 





The following comments are provide#frthe Draft Report on the Audit of 
TRAILBLAZER Program Execution se^. 
MTS 
1, РОЮ) Executive Summary, paragraph and Page 1, Developmental 
Concerns: These paragraphs begin; ILAZER encountered significant 
developmental problems and was G pass the system development and 
demonstration (Milestone B) phase ofthe" DoD Acquisition process.” 





(U//P@6@} RESPONSE: 









3. СОГЫС) Page 1, Objectives ра : This paragraph states: “The initial audit 
objective was to respond to a request гот the Senate Select Committee on Intelligence to 
determine why ће TRAILBLAZER Program was unsuctessfult what lessons should be 
learned, how to apportion responsibility forkhe program’§ probl&n 

Government received from its substantial mlti-year investment] 
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6. (iho oe Tae тыы le currently states = | 
continues as ee 8 
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Team Members 


The Department of Defense Office of the Deputy Inspector General for 
Intelligence prepared this report. Personnel of the Department of Defense, Office 
of Inspector General who contributed to the report are listed below. 


Shelton R. Youn; 





